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We establish new tail estimates for order statistics and for the 
Euclidean norms of projections of an isotropic log-concave random 
vector. More generally, we prove tail estimates for the norms of pro- 
jections of sums of independent log-concave random vectors, and uni- 
f*-^ ■ form versions of these in the form of tail estimates for operator norms 

t^** ■ °f matrices and their sub-matrices in the setting of a log-concave en- 

semble. This is used to study a quantity Ak <m that controls uniformly 
the operator norm of the sub-matrices with k rows and m columns of 
f- ») ■ a matrix A with independent isotropic log-concave random rows. We 

apply our tail estimates of A^ m to the study of Restricted Isometry 
Property that plays a major role in the Compressive Sensing theory. 
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1 Introduction 

In the recent years a lot of work was done on the study of the empirical 
covariance matrix, and on understanding related random matrices with in- 
dependent rows or columns. In particular, such matrices appear naturally in 
two important (and distinct) directions. Namely, 

- approximation of covariance matrices of high- dimensional distributions by 
empirical covariance matrices; and 

- the Restricted Isometry Property of sensing matrices defined in the Com- 
pressive Sensing theory. 

To illustrate, let n, N be integers. For 1 < m < N by U m = U m (R N ) we 
denote the set of m-sparse vectors of norm one, that is, vectors x G S N ~ X 
with at most m non-zero coordinates. For any n x N random matrix A, 
treating A as a linear operator A : M. N — ¥ M™ we define S m (A) by S m (A) = 

\Ax\ 2 — M\Ax\ 2 . (Here | • | denotes the Euclidean norm on M™.) 

et X G M. N be a centered random vector with the covariance matrix 
equal to the identity, that is, EXcg>X = Id; such vectors are called isotropic. 
Consider n independent random vectors Xi , . . . , X n distributed as X and let 
A be the n x N matrix whose rows are X±, . . . , X n . Then 

8 m (4=)= snp\-(\Ax\ 2 -E\Ax\ 2 )\ 
\\/nJ xP rrJn ' 
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-^(|(^,x)| 2 -E|(^,x)| 2 ) . (1.1) 



In the particular case of m = N it is also easy to check that 



A\ Ml " 






6 N [ -=) = ]]-> (X^Xi-EX^X) . (1.2) 

\\/n/ II n L — ' 

v i=l 

We first discuss the case n > N. In this case we will work only with the 
parameter 5n{A/ yjn). By the law of large numbers, under some moment 
hypothesis, the empirical covariance matrix - ~Y^i=i -%-i <S> Xi converges to 
EX ® X = Id in the operator norm, as n — > oo. A natural goal important 
for many classes of distributions is to get quantitative estimates of the rate 
of this convergence, in other words, to estimate the error term 5n(A/ \/n) 
with high probability, as n — > oo. 



This question was raised and investigated in [T7] motivated by a problem 
of complexity in computing volume in high dimensions. In this setting it was 
natural to consider uniform measures on convex bodies, or more generally, 
log-concave measures (see below for all the definitions). Partial solutions 
were given in [10] and [26] soon after the question was raised, and in the 
intervening years further partial solutions were produced. A full and optimal 
answer to the Kannan-Lovasz- Simonovits question was given in [5] and [7]. 
For recent results on similar questions for other distributions, see e.g., [29||2~T]. 

The answer from [5] and [7J to the K-L-S question on the rate of conver- 
gence stated that: 



1) <cJ-\ >l-e- c ^, (1.3) 





where C and c are absolute positive constants. The proofs are based on an 
approach initiated by J. Bourgain [10] where the following norm of a matrix 
played a central role. Let 1 < k < n, then 
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Ak,N = sup sup ( 2_, \(Xj,x)\ 2 \ = sup sup |P/Ae|, (1.4) 

JC{l,...,n} zeSiV-l \f— ' ' / JC{l,...,n} X (ZS N - 1 

\J\=h ~ 3^-> \J\=k 

where for J C {1, ... , n}, Pj denotes the orthogonal projection on the coor- 
dinate subspace M. J of W a . 

To understand the role of Ak,N f° r estimating Sjsf(A/^/n), let us explain 
the standard approach. For each individual x on the sphere, the rate of con- 
vergence may be estimated via some probabilistic concentration inequality. 
The method consists of a discretization of the sphere and then the use of an 
approximation argument to complete the proof. This approach works per- 
fectly as long as the trade-off between complexity and concentration allows 
it. 

Thus when the random variables - Yn=i I (-^»> x ) I 2 sa tisfy a good concen- 
tration inequality sufficient to handle uniformly exponentially many points, 
the method works. This is the case for instance when the random variables 
(X, x) are sub-gaussian or bounded, due to Bernstein inequalities. In the 
general case, we decompose the function |(Xj,x)| 2 as the sum of two terms, 
the first being its truncation at the level B 2 , for some B > 0. Now let us 
discuss the second term in the decomposition of Yu7=i \(Xi, x )\ 2 ■ Let 

E B = E B {x) = {i < n : \(X h x)\ > B}. 



For simplicity, let us assume that the maximum cardinality of the sets of the 
family {Eg(x) : x G S^ -1 } is a fixed non-random number k, then clearly 
the second term is controlled by 

£l<*<,*)l a <4„. 

i€E B 

In order to estimate k, let x such that k = \Eb(x)\ = \Eb\, then 

B 2 k = B 2 \E B \< ^|(X i; x)| 2 . 
ieE B 

Thus we get the implicit relation A\ N > B 2 k. From this relation and an 
estimate of the parameter A kjN we eventually deduce an upper bound for 
k. To conclude the argument of Bourgain, the bounded part is uniformly 
estimated by a classical concentration inequality and the rest is controlled 
by the parameter A^n- 

Notice that we only need tail inequalities to estimate Ak,N, that is to 
control uniformly the norms of sub-matrices of A. This is still a difficult 
task however because of a high complexity of the problem and the lack of 
matching probability estimates; and a more sophisticated argument has been 
developed in [5] to handle it. 

We now pass to the complementary case n < N, which is one of central 
points of the present paper, and was announced in [I] . 

Let A be an n x N random matrix with rows Xi , . . . , X n which are inde- 
pendent random centered and with covariance matrices equal to the identity, 
but not necessarily identically distributed. Clearly, A is then not invertible. 
The uniform concentration on the sphere Un = S 1 ^^ 1 (which appeared in 
the definition of 8 m (A/y/n) for m = N) does not hold and the expressions 
in ( II. ip are not uniformly small on Un = S N ~ l . The best one can hope for 
is that A may be "almost norm-preserving" on some subsets of S N ~ l . This 
is true for subsets U m , for some 1 < m < N and is indeed measured by 
8 m {Al^n). 

The parameter 5 m plays a major role in the Compressive Sensing theory 
and an important question is to bound it from above with high probability, 
for some (fixed) m. For example, it can be directly used to express the so- 
called Restricted Isometry Property (RIP) (introduced by E. Candes and 
T. Tao in [12]) which in turn ensures that every m-sparse vector x can be 



reconstructed from its compression Ax with n <C N by the so-called l\- 
minimization method. 

For matrices with independent rows X\, . . . ,X n , questions on the RIP 
were understood and solved in the case of Gaussian and sub-gaussian mea- 
surements (see [12], [23] and [8]). When X\, ...,X n are independent log- 
concave isotropic random vectors, these questions remained open and this is 
one of our motivation for this article. 

For an n x N matrix A and m < N, the definition of S m (A/ \/n) implies 
a uniform control of the norms of all sub-matrices of A/y/n with n rows and 
m columns. Passing to transposed matrices, it implies a uniform control of 
|P/Xj| over all I C {1, 2, • • • , N} of cardinality m and 1 < % < n. In order to 
verify a necessary condition that for some m, 8 m (A/\/n) is small with high 
probability, one needs to get an upper estimate for sup{|P/X| : |/| = m} 
valid with high probability. 

The probabilistic inequality from [21] 



P (\PiX\ > Ctxfm) < e~ tV ™ (1.5) 

valid for t > 1 is optimal for each individual /, but it does not allow to 
get directly (by a union bound argument) a uniform estimate because the 
probability estimate does not match the cardinality of the family of the J's. 
Thus the first natural goal we address in this paper is to get uniform tail 
estimates for some norms of log-concave random vectors. 

This heuristic analysis points out to the main objective and novelty of the 
present paper; namely the study of high-dimensional log-concave measures 
and a deeper understanding of such measures and their convolutions via new 
tail estimates for norms of sums of projections of log-concave random vectors. 

To emphasize a uniform character of our tail estimates, for an integer 
N > 1, an iV-dimensional random vector Z, an integer 1 < m < N, and 
t > 1, we consider the event 

Q(Z,t,m,N) = { sup \PjZ\ >Cty/^log(— )), (1.6) 

I- ic{i,...,n} \ m J ) 

\I\=m 

where C is a sufficiently large absolute constant. Note that the cut-off level 
in this definition is of the order of the median of the supremum for the 
exponential random vector. 



Recall that X, X\, . . . , X n denote N- dimensional independent log-concave 
isotropic random vectors, and A is the nxN matrix whose rows are Xi, . . . , X n . 
A chain of main results of this paper provides estimates for F(Q(Z, t, m, N)) 
in the cases when 

(i) Z = X; and, more generally, 

(ii) Z = Y is a weighted sum Y = 'Y^XiX i , where x = (xj)™ 6 M n , with 
control of the Euclidean and supremum norms of x, 

(iii) a uniform version of (ii) in the form of tail estimates for operator norms 
of sub-matrices of A. 

Our first main theorem solves the question of uniform tail estimates for 
projections of a log-concave random vector discussed above. 

Theorem 1.1. Let X be an X '-dimensional log-concave isotropic random 
vector. For any 1 < m < N and t > 1, 

¥(n(X,t,m,N)) <exp ( - ty/m\og (— V^/iogfem)). 

The proof of the theorem is based on tail estimates for order statistics 
of isotropic log-concave vectors. By (X*(i))i we denote the non- increasing 
rearrangement of (|X(i)|)f. Combining (jl.5p with methods of [18] and the 
formula sup/ C {i,...,iv} \PjX\ = (^™ =1 X*(i) 2 ) will complete the argument. 

Let us also mention that further applications (in Section H]) of inequality 
of this type require a stronger probability bound that involves a natural 
parameter o~x(p) - defined in (I3.3P - determined by a "£ p -weak" behavior of 
the random vector X. 

More generally, the next step provides tail estimates for Euclidean norms 
of weighted sums of independent isotropic log-concave random vectors. Let 
x = (xi)i G M n and set Y = Y^l x i^i — A*x. The key estimate used later, 
Theorem I4.3[ provides uniform estimates for the Euclidean norm of projec- 
tions of Y. Namely, for every x G M n , P( Q(Y,t, m, N) ) is exponentially 

small with specific estimates depending on whether the ratio II^Hoo/l^l is 
larger or smaller than 1/y/m. Since precise formulations of probability es- 
timates are rather convoluted we do not state them here and we refer the 
reader to Section HI 



The last step of this chain of results estimating probabilities of (jl.fip is 
connected with the family of parameters Ak yTn , with 1 < k < n and 1 < m < 
N, defined by 

1 /9 

Ak, m = sup sup ( 2_. \(Xj,x)\ 2 ) = sup sup |Pjv4x|. (1.7) 

IJI=fc JtJ \J\=k 

That is, Ak }Tn is the maximal operator norm over all sub-matrices of A with 
k rows and m columns (and for m = N it obviously coincides with (11.41) ). 

Finding bounds on deviation of A^, m is one of our main goals. To develop 
an intuition of this result we state it below in a slightly less technical form. 
Full details are contained in Theorem 15.11 

Theorem 1.2. For any t > 1 and n < N we have 



^(A k , m > CtX) < exp(-tA/ v / log(3m)), 

where X = A/log log(3m)A/mlog(eiV/m) + \/k\og{en/k) and C is a universal 
constant. 

The threshold value A is optimal, up to the factor of -\/loglog(3m). As- 
suming additionally unconditionality of the distributions of rows (or columns), 
this factor can be removed to get a sharp estimate (see [3]). 

We make several comments about the proof. Set T = A*. Then 
Ak, m = sup sup \PjTx\ = sup sup I y^XiPjXA . 

ic{i,...,n} xeU k (R n ) ic{i,...,n} xeU k (R n ) I ^ ' 

To bound Ak, m one has then to prove uniformity with respect to two families 
of different character: one coming from the cardinality of the family {/ C 
{1, . . . , iV} : |/| = m}; and the other, from the complexity of £4(M n ). This 
leads us to distinguishing two cases, depending on the relation between k 
and the quantity 

k' = inf{£ > 1: mlog(eiV/m) < ilog(en/£)}. 

First, if k > k', we adjust the chaining argument similar to the one from [5] 
to reduce the problem to the case k < k'. In this step we use the uniform tail 
estimate from Theorem 13.41 for the Euclidean norm of the family of vectors 



{PiX : |/| = m}. Next, we use a different chain decomposition of x and 
apply Theorem 14.31 

As already alluded to, an independent interest of this paper lies in upper 
bounds for 8 m (A/ y/n) where A is our n x N random matrix. We presently 
return to this subject to explain the connections. 

The family Ak, m plays a very essential role in studies of the Restricted 
Isometry constant, which in fact applies even in a more general setting. 
Namely, for an arbitrary subset T C M. N and 1 < k < n define the parameter 

A k (T) by 
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A k {T)= sup sup(V|(X,,y>| 2 ) . (1.8) 

Thus A k)Tn = A k {U m ). The parameter A k (T) was studied in [22] by means of 
Talagrand's 7-functionals. 

The following lemma reduces a concentration inequality to a deviation 
inequality and hence is useful in studies of the RIP. It is based on an argument 
of truncation similar to Bourgain's approach presented earlier. 

Lemma 1.3. Let X\, . . . , X n be independent isotropic random vectors in R . 
LetT C S^ -1 be a finite set. LetO < 9 < 1 and B > 1. Then with probability 
at least 1 — \T\ exp (—39 2 n/8B 2 ) one has 



sup 

2/6T 



n . 
where k < n is the largest integer satisfying k < (A k (T) / B) 2 



<9 + -(A k (T) 2 + EA k (T) 2 ), 
n 



In this paper we focus on the compressive sensing setting where T is the 
set of sparse vectors. The lemma above shows that after a suitable discretisa- 
tion, estimating S m or checking the RIP, can be reduced to estimating A k ^ m . 
This generalizes naturally Bourgain's approach explained above for m = N. 

Using the lemma, we can show that if < 9 < 1, B > 1, and m < 
N satisfy mlog(CN/m) < 39 2 n/16B 2 , then with probability at least 1 — 
exp (— 39 2 n/16B 2 ) one has 

5 m (A/Vn) <9 + - {A 2 Km + EAl m ) , 
n 

8 



where k < n is the largest integer satisfying k < (Ak^ m /B) 2 (note that k is a 
random variable). 

Combining this with tail inequalities from Theorem 11.21 allows us to prove 
the following result on the RIP of matrices with independent isotropic log- 
concave rows. 

Theorem 1.4. Let < 9 < 1, 1 < n < N. Let A be an n x N random 
matrix with independent isotropic log-concave rows. There exists c(8) > 
such that S m (A/ \/n) < 9 with an overwhelming probability, whenever 

mlog (2N/m) log log 3m < c(9)n. 

The result is optimal, up to the factor log log 3m, as shown in [6]. As for 
Theorem 15 .1\ assuming unconditionality of the distributions of the rows, this 
factor can be removed (see [3]). 

The paper is organized as follows. In the next section we collect the no- 
tation and necessary preliminary tools concerning log-concave random vari- 
ables. In Section [3j given an isotropic log-concave random vector X, we 
present several uniform tail estimates for Euclidean norms of the whole fam- 
ily of projections of X on coordinate subspaces of dimension m. As already 
mentioned, these estimates are based on tail estimates for order statistics of 



X. The main result, Theorem I3.4[ provides a strong probability bound in 
terms of the "£ p -weak" parameter ax {p) defined in (13.31) . The proofs of the 
main technical results, Theorems l3.2l and l3.4l are given in Section[71 SectionH] 
provides tail estimates for Euclidean norms of projections of weighted sums 
of independent isotropic log-concave random vectors. The proof of the main 
Theorem 14.31 is a combination of Theorem 13.41 and one- dimensional Propo- 
sition 14.31 In Section [5] we prove the result announced above on deviation 
of Afc m . Section [6] treats the Restricted Isometry Property and estimates of 
5 m (A/y/n). The last Section [7] is devoted to the proofs of technical results of 
Section [31 
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2 Notation and preliminaries 

Let L be an origin symmetric convex compact body in M d . This is the unit 
ball of a norm that we denote by || • ||x. Let K C M. d . We say that a set 
A C K is an e-net of K with respect to the metric corresponding to L if 

K c \J(z + eL). 

zgA 

In other words, for every x G K there exists z G A such that \\x — z\\l < £■ 
We will mostly use e-nets in the case K = L. It is well-known (and follows 
by the standard volume argument) that for every symmetric convex compact 
body K in M. d and every e > there exists an e-net A of K with respect 
to metric corresponding to K, of cardinality not exceeding (1 + 2/e) d . It is 
also easy to see that A C K C (1 — e) _1 convA. In particular, for any convex 
positively 1-homogenous function / one has 

sup f(x) < (1 - e)' 1 sup f(x). 

xeK xGA 

A random vector X in M. n is called isotropic if 

E(X,y) = 0, E\(X,y)\ 2 = \y\ 2 for all y G R", 

in other words, if X is centered and its covariance matrix EX^X is the 
identity 

A random vector X in M n is called log-concave if for all compact nonempty 
sets A,B CW 1 and 9 G [0, 1], ¥(X e9A + (l- 6)B) > ¥(X G A) e F(X G 
B) l ~ e . By the result of Borell [9] a random vector X with full dimensional 
support is log-concave if and only if it admits a log-concave density /, i.e. 
such density for which 

f(9x + (l-9)y)>f(x) 6 f(y) 1 - 6 for all x,y G R", 9e[0,l}. 

It is known that any affine image, in particular any projection, of a log- 
concave random vector is log-concave. Moreover, if X and Y are independent 
log-concave random vectors then so is X + Y (see [91 [HI [25]). 

One important and simple model of a centered log-concave random vari- 
able with variance 1 is the symmetric exponential random variable E which 
has density f(t) = 2~ 1 ^ 2 exp(— \/2|t|). In particular for every s > we have 
P(|£| > s) = exp(-s/ v / 2). 
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Every centered log-concave random variable Z, with variance 1 satisfies 
a sub-exponential inequality: 

for every s > 0, ¥(\Z\ > s) < Cexp(-s/C), (2.1) 

where C > is an absolute constant (see [9]). 

Definition 2.1. For a random variable Z we define the ipi-norm by 

\\Z\\ fl =inf{C>0 : Eexp(|Z|/C) < 2} 

and we say that Z is ipx with constant ip, if \\Z\\^ 1 < ip. 

A consequence of (12. ip is that there exists an absolute constant C > 
such that any centered log-concave random variable with variance 1 is ipi 
with constant C. 

It is well known that the f/^-norm of a random variable may be estimated 
from the growth of the moments. More precisely if a random variable Z is 
such that for any p > 1, \\Z\\ P < pK, for some K > 0, then H^H^ < cK 
where c is an absolute constant. 

By | • | we denote the standard Euclidean norm on M. n as well as the 
cardinality of a set. By (•, •) we denote the standard inner product on M n . 
We denote by 13% and S n ~ 1 the standard Euclidean unit ball and unit sphere 
inW 1 . 

A vector i 6 M" is called sparse or fc-sparse for some 1 < k < n if the 
cardinality of its support satisfies |suppx| < k. 

We let 

U k = U k (R n ) := {x e S 11 ' 1 : x is fc-sparse}. (2.2) 

For any subset I C {1, . . . , N} let Pi denote the orthogonal projection 
on the coordinate subspace M. 1 := {y G M> N : suppy C I}. 

We will use the letters C,C ,C\, . . ., c, c , Ci, . . . to denote positive abso- 
lute constants whose values may differ at each occurrence. 

3 New bounds for log-concave vectors 

In this section we state several new estimates for Euclidean norms of log- 
concave random vectors. Proofs of Theorems 13.21 and 13.41 are given in Sec- 
tion [3 
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We start with the following theorem, which was essentially proved by 
Paouris in [21] ■ Indeed, it is a consequence of Theorem 8.2 combined with 
Lemma 3.9 in that paper, after checking that Lemma 3.9 holds not only for 
convex bodies but for log-concave measures as well. 

Theorem 3.1. For any N -dimensional log-concave random vector X and 
any p > 1 we have 

(E|X| p ) 1/p <c((E|X| 2 ) 1/2 + sup (E\{t,X)\ p ) 1/p ), (3.1) 

where C is an absolute constant. 

Remarks. 1. It is well known (cf. [9J) that if Z is a log-concave random 
variable then 

(E|Z| p ) 1/p < C-(E\Z\ q ) 1/q for p>q> 2. 
Q 

If Z is symmetric one may in fact take C = 1 (cf. Proposition 3.8 in [20J) 
and if Z is centered then denoting by Z' an independent copy of Z we get 
for p > q > 2, 

(E\Z\ p ) 1/p < (E\Z - Z'\ p ) 1/p < -(E\Z - Z'\ q ) 1/q < 2-(E\Z\ q ) 1/q . 

q q 

Therefore if X 6 M. N is isotropic log-concave then 

sup {E\(t,X)\ p ) 1 / p <p sup (E|(t,X)| 2 ) 1 / 2 =p. 

Also note that (ElXj 2 ) 1 / 2 = \/N. Combining these estimates together with 
inequality (13TT]) . we get that (E\X\ p y/ p < C{^N + p). Using Chebyshev's 
inequality we conclude that there exists C > such that for every isotropic 
log-concave random vector X 6 R and every s > 1 

P (\X\ > C sVn) < e- sVW (3.2) 

which is Theorem 1.1 from |24j . 

2. It is well known and it follows from [9] that for any p > 1, (E|X| 2p ) 1//2p < 

C(E|X| p ) 1//p where C is an absolute constant. From the comparison between 
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the first and second moment it is clear that inequality ( 13.1 j) is an equivalence. 
Moreover, there exists C > such that 



f(\X\>c((E\X\ 2 ) 1/2 + sup (E|(t,X)H 1/ 



_ , v ._, , ..,, y>}\ < e - p 

and 



F (^\X\> ^(ElXlY 2 + ^snp m,X)\n 1/p )^ >min{i e^}. 

The upper bound follows trivially from Chebyshev's inequality. The lower 
bound is a consequence of Paley-Zygmund's inequality and comparison be- 
tween the p-th and (2p)-th moments of \X\. 

3. Since for any Euclidean norm || • || on M. N there exists a linear map T such 
that || x || = \Tx\ and the class of log-concave random vectors is closed under 
linear transformations, Theorem 13. II implies that for any N- dimensional log- 
concave vector X, any Euclidean norm || • || on R^ and p > 1 we have 

(E||X|n 1 / p <c((E||X|| 2 ) 1 / 2 + sup (E\(t,X)\ p )^ p 
V [|t[|.<i 

where (R-^, || ■ ||*) is the dual space to (R N , || ■ ||). It is an open problem whether 
such an inequality holds for arbitrary norms - see (19] for a discussion of this 
question and for related results. 

We now introduce our main technical notations. For a random vector 
X = (X(l), . . . , X(N)) in R N , p > 1 and t > consider the functions 

a x (p)= sup (E\(t,X)\») 1/p (3.3) 

and 

N 

That is, Nx{t) is equal to the number of coordinates of X larger than or 
equal to t. By a x l we denote the inverse of ax i.e., 

o-^O) = sup{t: a x {t) < s}. 

Remark 1 after Theorem 13.11 implies that for isotropic vectors X, ax{tp) < 
2ta x (p) for p > 2,t > 1 and (T x 1 (2ts) > ta x l (s) for t,s > 1. 
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We also denote a nonincreasing rearrangement of |X(1)|, . . . , |X(iV)| by 
X*(l) >X*{2) > ... >X*(N). 

One of the main technical tools of this paper says: 

Theorem 3.2. For any X -dimensional log-concave isotropic random vector 
X, p>2 andt> Clog (xt 2 /a 2 x (p)\ we have 

E(t 2 N x (t)y<(Ca x (p)) 2 v, 
where C is an absolute positive constant. 

We apply Theorem 13.21 to obtain probability estimates on order statistics 
X*(i)'s. 

Theorem 3.3. For any X -dimensional log-concave random isotropic vector 
X, anyl<£<X and t > C\og(eN/£), 

P(X*(£)>t)<exp(-a x 1 (itv / f)), 

where C is an absolute positive constant. 

Proof. Observe that o~-x(p) = <7x{p) and that X*(£) > t implies that 
N x (t) > 1/2 or N- X (t) > 1/2. So by Chebyshev's inequality and Theo- 
rem [32J 

nx*(£) >t)< Q\EN x (ty + Ex_ x (ty) < {^P-) 2P 

provided that t > C" log(Nt 2 / a x (p)) , where C',C" are absolute positive 
constants. To conclude the proof it is enough to take p = ^^(-^ty/I) and to 
notice that the restriction on t follows by the condition t > Clog(eN/£). □ 

We can now state one of the main results of this paper. 

Theorem 3.4. Let X be an isotropic log-concave random vector in M N and 
m < N. For any t > 1, 



P| sup 

IC{1,...,N} 
\I\=m 



\P,X\ > ttVSJlog (*)) < exp (-,? (h^jML)) 



where C is an absolute positive constant and 

m = m (X, t) = sup < k < m: k log ( —— j < a x l \t\fm\og ( ) ) [ • 
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Remark. We believe that the probability estimate should not contain any 
logarithmic term in the denominator, but it seems that our methods fail to 
show it. However it is not crucial in the sequel. 

Since crx{p) < P-, Theorem 11.11 is an immediate consequence of Theo- 
rem [331 

4 Tail estimates for projections of sums of 
log-concave random vectors 

We shall now study consequences that the results of Section [3] have for 
tail estimates for Euclidean norms of projections of sums of log-concave 
random vectors. Namely, we investigate the behavior of a random vector 
Y = Y x = X^r=i x *^' where X±, . . . ,X n are independent isotropic log- 
concave random vectors in M. N and x = (xj)™ e 1" is a fixed vector. We 
provide uniform bounds on projections of such a vector. We start with the 
following proposition. 

Proposition 4.1. Let X\, . . . ,X n be independent isotropic log-concave ran- 
dom vectors in M. N , x = (xj)™ G M. n , and Y = 'Y^ =1 XiX i . Then for every 
p>\ one has 

cr Y {p)= sup (E\(t,Y)n 1/p <C(^p-\x\+p\\x\U, 
test*- 1 

where C is an absolute positive constant. 
Proof. For every t G S N ~ X we have 

n 

(t,Y) = Y,Xi(t,Xi)- 



8=1 



Let Ei be independent symmetric exponential random variables with variance 
1. Let t G S 1 ^^ 1 and x = (xj)™ G 1R™. The variables Zi = (t,Xi) are one 
dimensional centered log-concave with variance 1, therefore by (j2.ip for every 
s > one has 

V(\Z i \>s)<C V(\E i \>s/Co). 
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Let (£j) be independent Bernoulli ±1 random variables, independent also 
from (Zi). A classical symmetrization argument and Lemma 4.6 of [2T] imply 
that there exists C such that 



p\ i/p 



t=l i=l 

The well-known estimate (which follows e.g. from Theorem 1 in 

i/p 



p\ i/p 



E^^ <C(VpM +p|M|oo) 



»=i 



concludes the proof. 



□ 



Corollary 4.2. Lei X 1; . . . , X n , x and Y be as in Proposition \4-l\ and 1 < 
£ < N. Then for any t > C\x\ log (^j-) one has 

1 f t 2 £ t\fl 

¥(Y*(£) >t)< exp I -— min 



C 1 bl 2 ' \\x\\ c " 



where C is an absolute positive constant. 

Proof. The vector Z = Y/\x\ is isotropic and log-concave. Moreover by 
Proposition 14.11 we have 



crz(p) = i~ ro-y(p) <CAy/p + p- 
\x\ V 

Therefore for every t>C\ 

a-^^y-^minlt 2 ,^ 
^2 k || a^ || oo 

and by Theorem 13.31 we get for every t > C 3 \x\ log i^j-) 

¥(¥*(£) >t)=Ffz*(£) > ±) <exp (_^(M 

/ 1 . (t 2 £ tVI 
< exp I — — mm < 



\x\ \\x\ 



D 
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The next theorem provides uniform estimates for the Euclidean norm of 
projections of sums Y x , considered above, in terms of the Euclidean and foo 
norms of the vector i£l n . 

Theorem 4.3. Let X%, . . . ,X n be independent isotropic log-concave random 
vectors in W N , x = (xj)" £ P n , and Y = Yli=i x i-^i- Assume that \x\ < 1, 
Halloo < b < 1 and let 1 < m < N. 

i)Ifb> -j= then for any t > 1 

( ,eN\\ / tVmlog(f) 

P sup \PjY\ > Ct^log ( — ) < exp - - \ J 

\ ic{i,...,n } \m J \ bJ\og(e 2 b 2 m) 

ii) if b < -7^ then for any t > 1 



\PjY\ > Ct^llog (— ) ) 



P| sup 

/C{1 N} 

\I\=m 

< exp ( — min < t 2 m log 2 ( ) , - v^log ( ) 

\ L \ m / b V m / 

where C is an absolute positive constant. 

Remark. Basically the same proof as the one given below shows that in i) 
the term ^log(e 2 b 2 m) may be replaced by ^J\og(e 2 b 2 m/t 2 ) and the condition 
b > -!= by b > -4=. We omit the details. 

The proof of Theorem 14.31 is based on Theorem 13.41 Let us first note 
that we may assume that vector Y is isotropic, i.e. \x\ = 1. Indeed, we 
may find vector y = (yi, . . . ,ye) such that \\y\\oo < b and \x\ 2 + \y\ 2 = 1 and 
take Y' = Y2i=iViGi, where Gi are i.i.d. canonical iV-dimensional Gaussian 
vectors, independent of vectors X^s. Then the vector Y + Y' is isotropic, 
satisfies assumptions of the theorem and for any u > 0, 



P ( 

IC 

\I\=m 



sup \PiY\>u)<2¥[ sup \Pi(Y + Y')\ > u) . 

{1,...,JV} / V IC{1,...,N} J 



Similarly as in the proof of Corollary 14.21 for t > C we have 



^W^min/t 2 ,^^. (I- 1) 

t> L \\ X \\c 
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This allows us to estimate the quantity m in Theorem 13.41 For \j\fm < 
b < 1 define mi = mi(b) > by the equation 

„n, ( eN \ Jm , /eiV\ , . 

m 'W io 4^(6)j=V iog (^)- <"> 

One may show that m\ (b) ~ ^p log(^)/log(^r=), we will however need 
only the following simple estimate. 

Lemma 4.4. If \j\fm < 6 < 1 £/jen log(m/mi(fo)) < 21og(e6 v /m). 

Proof. Let /(z) = zlogf^eiV/z). Using l/\/m < b we observe 

'00 = ^0* (£) + wv) * f * (£) + ^ 

*f*(£)(?+7)<f*(£)-'W»»- 

Since / increases on (0,iV], we obtain mi(b) > (eb)~ 2 , which implies the 
result. □ 

Proof of Theorem \4-3[ As we noticed after remark following Theorem I4.3[ 

without loss of generality we may assume that |x| = 1, i.e. that Y is isotropic. 

i) Assume b > 1/ 'y/m. By ( 14. ip for every t > C/(y/m\og(eN/m)) we have 



a-( ( ^log(y)>^log(^). (4.3) 

By (j4.2p it follows that for every t>\x\ = l 

By the definition of m , given in Theorem 13 A\ this implies that mo(Y, Ct) > 
[mi(6)J , and since mo(Y, Ct) > 1 we get i71q(Y, Ct) > mi(fo)/2. By Lemma H~4l 
this yields log(em/mo(Y, Ct)) < 2 + 2\og(eby/m) < 4\og(eb\/m). 
Writing t = t' \/2\og(e 2 b 2 m) and applying ( 14. 3ft we obtain 

i /Vmlogf^rA if , ,-, feN\\ t' _ /eJV\ 
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Theorem 13.41 applied to Ct instead of t implies the result (one needs to adjust 
absolute constants). 

ii) Assume b < 1/ yfm. By ( 14. II) for every t > C\x\ we have 



ay 1 \t\fm\og ( — J J > — min <u 2 mlog 2 ( — j, -y/mlog ( 



eN_\ 

m J 

> 7^ log! — ), 
C V m / 

which by the definition of mo implies that mo(Y,Ct) = m. As in part i), 
Theorem 13.41 implies the result. □ 

5 Uniform bounds for norms of sub-matrices 

In this section we establish uniform estimates for norms of submatrices of a 
random matrix, namely for the quantity Ak }m defined below. 

Fix integers n and N. Let X\, . . . , X n e M, N be independent log-concave 
isotropic random vectors. Let A be the n x N random matrix with rows 
X\, . . . ,X n . 

For any subsets J C {1, . . . , n} and I C {1, . . . , A^}, by A(J, I) we denote 
the submatrix of A consisting of the rows indexed by elements from J and 
the columns indexed by elements from I. 

Let k < n and m < N. We define the parameter A^^ m by 

A k , m = sup\\A(J,I)\\ e ,n^ e k, (5.1) 

where the supremum is taken over all subsets J C {l,...,n} and / C 
{1,...,N} with cardinalities \J\ = k,\I\ = m. That is, A^ )Tn is the max- 
imal operator norm of a submatrix of A with h rows and m columns. 

It is often more convenient to work with matrices with log-concave columns 
rather than rows, therefore in this section we fix the notation 



'■■ 



A*. 



Thus r is an iV x n matrix with columns X\, . . . ,X n . In particular, given 
x G M n the sum Y = J27=i x iXi considered in Section @] satisfies Y = Tx. 
Clearly, 
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so that, recalling that U k was defined in ( 12. 2p . we have 

A Km = r m , fe = sup{|P 7 rx| :IC{1,...,N}, \I\=m, xe U k }. (5.2) 

Define Afc jm and A m by 

I - — /emaxiiV, n}\ i— /en\ 

Afc, m = V lo g lo s( 3m ) V^log ( J + vfclog ( — J, (5.3) 

and 

A/log log(3m) y/m /emax{iV,n}\ 

Am = A m \ log ) • 5 - 4 

A/log(3m) \ m J 

The following theorem is our main result providing estimates for the op- 
erator norms of submatrices of A (and of V). Its first part in the case n < N 
was stated as Theorem 11.21 

Theorem 5.1. There exists a positive absolute constant C such that for any 
positive integers n,N, k < n, m < N and any t > 1 one has 

P (^4fe, m > Ct\ Km ) < exp ' 



A/log(3m) 

In particular, there exists an absolute positive constant C\ such that for every 
t > 1 and for every m < N one has 

P (3k A Km > Cit\ ktm ) < exp (-tXm) . (5.5) 



First we show the "in particular" part, which is easy. 

Proof of inequality ( 15. 5\) . The main part of the theorem implies that for every 
t> 1 

n 

p m :=P(3A; A Km > Ct\ k , m ) < J^exp ^-tA fc , m /\/log(3m)J . 

fc=i 

Thus if m > log 3 n then for every t > 100 one has 

Pm < nexp (-t\ m ) < exp (-(t/2) A m ) . 
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If m < log 3 n (in particular n > 3) then for every t > 100 one has 

p m < ^ exp f-tA fe , m /v / log(3m)J + ^ exp ( -t\ k , m / y / \og(3m] 

fe<(logn) 2 fc>(logn) 2 

< (log nf exp (-t\ m ) + exp (-U m ) ^ exp (-ta k , m ) , 

fc>(logra) 2 

where _ 

\/k fen\ 

ak, m = , , log I — 1 . 
v/log(3m) U/ 

Since m < log 3 n, we obtain for every t > 100 

Pm < exp (-(£/2)A m ) + exp (-£A m ) < exp (-(i/4)A m ) . 

The result follows by writing t = 100t' and by adjusting absolute constants. 

□ 

Now we prove the main part of the theorem. Its proof consists of two 
steps that depend on the relation between m and k. The Step I is applicable 

if m log f ^ J < k log ( ^7 j , and it reduces this case to the second comple- 
mentary case m log f ^ 1 > k log ( ^r ) • The latter case will then be treated 
in Step II. To make this reduction we define k' as follows 

k' = inf UeN : k < n and k log ( -=- ) > m log ( — 1 > (5-6) 

(of course if the set in (15.61) is empty, we immediately pass to Step II). 

5.1 Step I: /clog (^f J > ralog (^), in particular k > k'. 
Proposition 5.2. Assume that k > k! . Then for any t > 1 we have 

sup sup l-P/Txl < C( sup sup l-P/Txj 
ic{i,...,n} xeu k ^ ic{i,...,n} xeu k , 

\I\=m 

+ t^Rlog (— ) + tv^log {^pj ) (5.7) 
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with probability at least 



1-nexp (.^MeiV/nOWfcMen/fc)^^ ^^ ^y (g _ g) 

where C is a positive absolute constant. 

The proof of Proposition 15.21 is based on the ideas from [5] . We start it 
with the following fact. 

Proposition 5.3. Let (X$)$< n be independent centered random vectors in 
M. N and ip > be such that 

E exp ( ^*V^ ) < 2 /or alli<n,6e S N ~\ 

Then for 1 < p < n and t > 1 rai/i probability at least l — exp(—tplog(en/p)) 

the following holds: 

for all y,z eU p and all E, F C {1, . . . , n} mi/i E H F = 0, 



1 /9 

J] 2/iXi, J^ ^X^ < 20£plog ^JVniax |^| ( J^ 4) T 

where T p := max^^ \Tx\ = max xeUp \ Yh=i x i X i\- 

Proof. In this proof we use for simplicity the notation [n] = {1, . . . , n}. First 
let us fix sets E, F C [n] with EOF = 0. Since we consider y,z £ U p , without 
loss of generality we may assume that |.E|, |.F| < p. For z G U p denote 

y f( z ) = ^2 z 3 X j and Z f( z ) = \Y( Z )\ 
jeF \ F\ )\ 

(if Yp(z) = we set Zp(z) = 0). For any y,z G U p we have 

j2yi x ^J2 z ^)\^J2\y4( XhYF ^ 

ieE jeF ieE 

< max. \yi\ \Y F (z)\ V" \(Xi,Z F (z) 

ieE ' I \ 

ieE 
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The random vector Zp(z) is independent from the vectors X{'s, i G E, more- 
over \Z F (z)\ < 1 and \Y F (z)\ < (J2 jeF z]) 1/2 T p . Therefore for any z E U p 
and u > 0, 

P ( 3 J/ec/ P | ( Jj/i-Xi, Yl z i X J ) > U ^P max \yi\(y2 z j) V p) 



i&E jeF 



j£F 



<v(22\(Xi,Z F (z) 



i£E 



> Ulf) 



<e- u Eexp^ 

i£E 



\( Xj,Z F (z))\ 
1> 



< 2 |E| e-" < 2 p e~ u . 



Let N F denote a 1/2-net in the Euclidean metric in Bl£ D M. F of cardinality 
at most 5' F ' < 5 P . We have 



Pe,f{u) 



V\^yeU p ^z£U p 



1 /9 

< P ^3^^ 3 zeNp | ^ J^ ^X i7 Y z j X j ) >uip max |?/i | ( JZ z f) T 

i£E jeF '" jGF 

^ J2 p ( 3 ^ | ( Yl y* x *> J2 z i x j) > u ^ ™a \v*\ ( J2 z f) t p 



zeN F 

< We~ u . 



iGE jGF 



j&F 



Hence 



H ^yeUp^zeU p ^E,Fc[n],\E\,\F\<p ) EnF= 



1 /9 

^ y t X { , Y Z J X J ) | > 2w< max | y t | ^ J^ z| J T p 



iG-B jeF 



< 



£ 



jeF 
Pe,f(u)< ( n )( n )l0?e- u <e- u /\ 



E,Fc[n],\E\,\F\<p,EnF=0 

provided that u > 10plog(ne/p). This implies the desired result 



□ 



Before formulating the next proposition we recall the following elementary 
lemma (see e.g. Lemma 3.2 in [5]). 
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Lemma 5.4. Let x%, . . . , x n G JL N , then 

^2(xi,Xj) < 4 max V ^(x^Xj). 



i¥=j 



i&E j£E c 



Proposition 5.5. Let (Xi)i< n be independent centered random vectors in 
M. and ip > be such that 

Eexp (MlM) < 2 for alli<n,6e S N ~\ 



Let p < n and t > 1. Then with probability at least 1 — exp(— tp\n(en/p)) for 
all x G Up, 



n 

y XiXi < C(\x\ max \Xi\ + tplog f — J^H^ 



i=l 



7> 



where C is an absolute constant. 

Proof. As in the previous proof we set [n] = {1, . . . , n}. Fix a > and define 



n 

T p (a) = sup J \^2 x i x i 



* ^^ 23 5 *"^ OO ' L* | • 



For £ C [n] with \E\ < p let iV s (a) denote a 1/2-net in R £ n ££ n afioo 
with respect to the metric defined by B^ D a-Boo- We may choose Ne(ch) of 
cardinality 5 |£| < 5 P . Let JV(a) = \J\ E[=p N E (a), then 



(tf-"in \ I 
J and r p (a) < 2 sup >^ a^Xj 
P / ' xeiV(a) I ~^ 



\N(a)\ < 
Fix E C [n] with |i£| = p and x G Ne(cx). We have 

" 2 n 



(5.9) 



i=l 



t=l 



Therefore Lemma [5.41 gives 



y XiXi < max \Xi\ 2 + 4 sup ( \, ^i^i; 7, x j^j 

ieF j€E\F 



i=l 



FCE 
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Notice that for any F C E, max ieF \xi\ < a and | ^2j £E \ F XjXj\ < T p (a) 
hence as in the proof of Proposition 15.31 we can show that 

ieF jeE\F 

Thus 

n 2 

F( \J2 x i x i > max \ x i\ 2 + 4mpaT p (a)) < ^ 2 |F| e~ u < 3 lEl e~ u . 



i=l FcE 

This together with (15. 9 p and the union bound implies 

15en\p 
P 



P(T p (a) 2 > 4 max |X;| 2 + 16u^aT p {a)) < J^ ^^ ^ 0^-Ye~ u - 



xeN(a) 

Hence 



Pf T p {a) > 2 v / 2max |JQ| + 32uip<x\ < ( ) e~ u . (5.10) 

Using that r p (o;) > T p ((3) for a > (3 > we obtain for every £ > 1 



n 

H^xeu p l^XiXi > 2v / 2max|X i | +M^max{||x|| 00 ,2^} 

i=l 

= P( 3 2 - f <«<i r p (a) > 2v2max |JQ| + u?/>cm 

< P(3 < i <^-i V p (2- j ) > 2v / 2max|X i | + -uip2~ j ^ 

< £>(r p (2-'') > 2v / 2max|X i | + -u^') < e^—Ye-"' 6 *, 



P J 

where the last inequality follows by (j5.10p . Taking l ps logp (so that \x\oo > 
2~ l \x\) and u = Ctplog(en/p), we obtain the result. □ 



Proof of Proposition \5.2 . For any / C {1, . . . , N}, the vector PjX is isotropic 
and log-concave in M. 1 , hence it satisfies the ip\ bound with a universal con- 
stant. 
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We fix t > 10. Let s > 1 be the smallest integer such that k2 s < k'. Set 
k^ = [k2 l ~»\ - [k2-»\ for \x = 1, . . . , s and k s+1 = [k2~ s \ . Then 



u s + 1 



y 

max{l, Lfc2 _/i J} < ky, < k2 1 ~ 11 , — < k s+1 < k', and ^k fl = k. (5.11) 

/x=l 

Consider an arbitrary vector x = (x(i))j € £/& and let ni,...,rik be 
pairwise distinct integers such that |x(ni)| < |rc(rz 2 ) | < ... < |a;(rife)| and 
x(i) = for i <£ {m, . . . , n k }. For /i = 1, . . . , s + 1 let F M = {^}j M <i<i M+1 , 
where j^, = J2r<u^r (ji = 0). Let x^ be the coordinate projection of x 
onto R Fa \ Note that for each \i < s we have |x.fJ < 1 and ||a;j? ||oo < 
l/y / k-j, +1 + 1< v^A. 

The equality x = X!u=i X -F M yields that for every J C {1, . . . , JV} of cardi- 
nality m, 

s s 

\PiTx\ < |P 7 rx s+1 | + I Vp 7 rxF M < sup sup |p 7 rx| + I Vp ; ri F( , 

I , -fC{l iV} x( zU ,./ I i 

A» =1 |/|=m * M =1 

where in the second inequality we used that k s+ i < k! . 

Taking the suprema over / of cardinality m and x G U\~ we obtain 



Ak,m = sup sup |P/Tx| < sup sup |P 7 rx| + sup sup 2 ] Pi^xf^ 

IC{1,...,N} xeU k IC{1,...,N} xeUy IC{1,...,N} X £U h I ~i 

\I\=m |I|=m |I|=m H 1 1 

(5.12) 
Note that 

8 9 S S—l S 

|^p 7 rx F , t | =^|p / rx F j 2 + 2^(p / rx M! £ PjTx u ). (5.13) 

/i=l £*=! M = l v=/u+l 

We are going to use Proposition 15.51 to estimate the first summand and 
Proposition 15.31 to estimate the second one. First note that by the definition 
of k' and s we have 

fN\ feN\ m /,, en\ , k , 2A; 2n 

< — < exp ( fc' log — J and — < 2 s < — < — . 
\m) ~ \m ) ~ P V 5 W fc' ~ k' ~ k' 
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Hence, using the definition of k^s, we observe that for t > 10 we have 

, J Yl exp ( ~ tk v log (t~) ) - s exp (^ log ~jj) exp ( ~ tfcs log (t~ 

<iexp(-(^/2)log(^)). 

Since x^ G C4 for every x E Uk and /i = 1, . . . , s, the union bound and 
Proposition 15.51 imply that with probability at least 

1 -E(I)-p(-^.o g (^)) £1 -iexp(- W2 ) 1 o g (f)), 
for every xG(/fc, every / of cardinality m, and every \x E {1, . . . , s} one has 

|P/rx F J < ^(ix^lmaxlP^I +tA; M log(p)y^), (5.14) 

where C is an absolute constant. 

Similarly, by Proposition 15. 3[ with probability at least 

l-^ex P (-(U72)log(^)), 

for every x E C4, every / of cardinality m and every \i G {1, . . . , s} one has 



(PjTx^, J2 PiTx u )<Ctk^log(^jJjA k;m , (5.15) 



!/=/H-l 



where we have used the facts that X]^=u+i x » e ^fc M anc ^ Si> l x ^| 2 — 1- 

Using ( I5.12p - ( I5.15P we conclude that there exists an absolute constant 
C\ > such that with probability at least 1 — exp(— (tk'/2) log(en/k')), 

s 

Al m <C( sup sup \PiTx\ 2 +y Ixp | 2 max max \PiXA 2 

V IC{1,...,N} x£U k , ~ * IQ{1 N} 

\I\=m M =1 l 7 l= m 

< Ci( sup sup |P/Px| 2 + max max |Pt-Xj| 2 

V IC{1,...,N} x£ U k , * /C{l,...,iV} 

|I|=m l J l= m 

+ £ 2 Hog 2 (y) + £v / Hog (y)^W 
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Thus, with the same probability 



Akm < C2I sup sup \PiTx\+ max max \PiXA + tVklog ( 

\ IC{1,...,N} xeU ,, i JC{1 iV} V 



fen\ 
k) 

|I|=m 



where C2 > is an absolute constant. 

But by Theorem 1 1 . 1 1 and the union bound we have for every t > 1, 

max max |P/Xj| < Cs[t\/m\og(eN/m) + tvk\og(en/k) ), 

« ^C{1 iV} v / 

with probability larger than or equal to 

/ \/m\og(eN I m) + yk\og(en/k)\ 

p := 1 -nexp -t 

V v log em / 

(we added the term depending on k to get better probability, we may do 
it by adjusting t). This proves the result for t > 10 with probability 
Po — exp(—(tk'/2)\og(en/k')). Passing to to = t/20 and adjusting absolute 
constants, we complete the proof. □ 

5.2 Step II. A: log (f) < mlog (^\ in particular k < k'. 

In this case we have to be a little bit more careful than in the previous case 
with the choice of nets. We will need the following lemma, in which [/*. 
denotes the set of /c-sparse vectors of the Euclidean norm at most one. 

Lemma 5.6. Suppose that k < n, kx,k 2 , . . . ,k s are positive integers such 

that k\ + . . . + k s > k and k s+ i = 1. We may then find a finite subset M of 

I £4 satisfying the following. 

i) For any x & C4 there exists y 6 H such that x — y € \Uk- 

ii) Any x G J\f may be represented in the form x = tti(x) + ... + tt s (x), 

where vectors 7i"i(x), . . . , n s (x) have disjoint supports, |supp (7Ti(x))| < ki for 

i= l,...,s ; 

s 

J]^ +1 ||7r i (x)|| 2 0O <4 

and 

f en \ 3&i 
1^(^)1 = |{7r 4 (x) : x E Af}\ < (-) for i = 1, . . . , a. 
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Proof. First note that we can assume that k\ + k 2 + . . . + k s = k. Indeed, 
otherwise denote by j the largest integer such that kj + kj +1 + . . . + k s > k. 
If j = s then set kj = k, if j < s then set k{ = k{ for j < i < s, kj = 
k — kj+i — kj + 2 — . . . — k s , 7Ti(x) = for i < j and repeat the proof below for 
the sequence kj, fcj+i, . . . , k s , k s +i, where k s+ ± = 1 as before. 

Recall that for F G {1, . . . , n}, M. F denotes the set of all vectors in M. n 
with support contained in F. 

For % = 1, . . . , s and F C {1, . . . , n} of cardinality at most ki let Mi(F) 
denote the subset of S F (i) := R F n B% n k~^{ 2 B^ such that 



s F (i)cM(F) + ^(BSnk^l 2 B, 



Standard volumetric argument shows that we may choose Mi(F) of cardinal- 
ity at most (6n//cj)! F ! < (6n/ki) ki (additionally without loss of generality we 
assume that G Mi(F)). We set 

Mi ■= |J Mi(F), 

\F\<ki 



then 



en\ k * (Gn\ k i /en\ 3k i 



wi^rJ (k) ^KkJ 



Fix x E C/fc, let F s denote the set of indices of fc s largest coefficients of 
x, F s _i - the set of indices of the next fc s _i largest coefficients, etc. Then 
x = x Fs + x Fs _ 1 + . . . + x Fl , \\x Fa ||oo < 1 and 

Halloo < r- \Xp i+1 \ < r- for l < S. 

In particular, x^ G M Fl fl 5J H fcZ. / B^ for all i = 1, . . . , s. Let 7Ti(x) be a 
vector in Mi(Fi) such that 



fe 



z Fi - 7Ti(x)| < — - and \\x Fi - ^(zjlloo < 



Define also n(x) — iri(x) + . . . + n s (x). Then 

\x — n(x)\ < > \x F — TTi(x)\ < > — = — < - 

i=i i=i 

29 



and 

s s—l 



- ^UJllL) 



i=i i=i 

s-1 



5^fci+i|Ms)||^ < I + 2j2k i+1 (\\x Fi \\l + \\x Fi -Hi 

^ + 2 E (|, F , +i r + (A) 2 )<l + 2tf + il<4. 

1=1 

Thus we complete the proof by letting 

J\f = {n(x): x G U k }. 

a 

Lemma 5.7. Suppose that n < N and k < min{n, k'}. Then for some 
positive integer s < Cloglog(3m) we can find s + 1 positive integers k\ = k, 
ki G [|m 1//4 ,m] for 2 < i < s, k s+1 = 1 satisfying 

/ en\ 
Mog(— ) <^g(k i+1 ), fori = l,...,s, (5.16) 

where C is an absolute positive constant and 

V^ lQg (e_N\ if Z <m, 

_ _ y/log(e 2 m/z) \ m ) 

min < \fzm log ( ^ J , m log ( ^ ) r if z > m. 

Proof. Let us define 

/ en\ /cN\ 

h(z) = zlogl — J and H(z) = zlogl — J. 

Notice that h(z) < H(z), h is increasing on (0, n] and H is increasing on 
(0, TV]. It is also easy to see that /i(|V|) < 2h(z) for z G [l,n]. 

We first establish some relations between the functions g and H. It is not 
hard to check that log ' (e 2 m) < e 2 y/m, therefore for z G [l,ra], 

/ Jzm \ \fzrn /, /eN\ , /mlog ' (e 2 m) 

Hi — ^ = — ^ log — +log ^=L '- 

Vlog 3/2 (e 2 m)^ log 3/2 (e 2 m)V b U/ ta V ^zlK 



< 



'zm , /eiV 



log 3/2 (e 2 m) ' \ m J 
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log f — ) (1 + log(e 2 m)) < 2^(«). (5.17) 



Write z = pm with p G (0, 1), so H(2z) = 2pm (log (^) + log (§)). Then 

H{2z) < 2v f? log (— ) Vplog(e 2 /p)(l + log(l/p)) < 10<7(z), (5.18) 
A /log(e 2 /p) V m y 

where the last inequality follows since 

sup 2 A /py /l °g( e2 /p)( 1 + log(l/p)) = 2 sup e _ V2 + 2u(l + 2u) 
pe(o,i) «>o 

< 2 v / 2supe~ u/2 (l + 2m) < 10. 

Let us define the increasing sequence £o,£i, ■ ■ ■ , i s -i by the formula 

£ = 1 and h(£i) = lOg(ii-i), i = 1, 2, . . . , 

where s is the smallest number such that £ s _i > m (if at some moment 
10g(£j^i) >nwe set £_,■ = m and s = j + 1). First we show that such an s ex- 
ists and satisfies s < C log log(3ra) for some absolute constant C > 0. We will 
use that h(z) < H(z). By (15171) if ^_ x < m then £ > y/e~m/]o^ /2 {e 2 m), 
which implies 

^i > Vm/\og 3/2 (e 2 m) > -m 1/4 (5.19) 

6 

and, by induction, 



771 



1-2" 



> I : — - ) fori = 0,1, 2,... 



dog 3 (e 2 
In particular we have for some absolute constant Ci > 0, 

Tfl 

4i > — — 37 : for some Si < Ci loglog(3m). 
2 log (e 2 m) 

By fl5TT8|) we have 7i(2z) < #(2z) < 10g(z) for z < m, so, if ^_i < m then 
A > 2£j_!. It implies that for some s < si + C 2 loglog(3m) < Cloglog(3m) 
we indeed have £ s _i > 777. 

Finally we choose the sequence (ki)i< s +i i n the following way. Let k\ — k 
and ki := min{m, |~£ s+ i_j]}, i = 2, . . . , s + 1 (note that k 2 = m, k s+ i = 1). 
Using /i(|V|) < 2/7(2;) and construction of £j's, we obtain (I5.16P for i > 2, 
while for i = 1 by definition of fc' and since k < k' we clearly have h(ki) = 
h(k) < 2g(m) = 2g{k 2 ). Since (£i)i is increasing we also observe by ( 15. 19ft 
that ki > |m 1//4 for 2 < i < s. This completes the proof. □ 
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Proposition 5.8. Suppose that N > n and k < min{n, k'}. Then for t > 1, 

P( sup sup |-P/Tx| > Ct a/ log log(3m) y/m log ( — ) ) 
V ic{i,...,n} x< =u k V m / / 

\I\=m 

t A/log log(3m) \fm \og(eN/m) 



< exp ( 



^/log(em) 

where C is a universal constant. 

Proof. Let fci, . . . , fc s +i be given by Lemma I5TT1 and A/" C §[/& be as in Lemma 
EH1 Notice that 

sup sup |-P/Tx| < 2 sup sup |P/T;c|, 

rc{i,...,w} xe^ ic{i,...,iv} xgA^ 

\I\=m \I\=m 

so we will estimate the latter quantity. 

Let us fix x G N and 1 < i < s. We apply Theorem 14.31 to the vector y = 
Ki(x)/(\fh+i lki(^)||oo + ki (a?)l) (observe that |y| < 1 and H^Hoo < I/a/^+i 
and on the other hand 1/y/ki+i > -j=) to get for u > 0, 

Pf sup |P/r7Ti(x)| > ^-s/fe+ilki^Hoo + ki(x) |) Vm log f— ) + 

a/^+iM 



< exp ( - l(%(fc i+1 )) exp ( - V )== 
v / v C a/ log (em) 



where g»(x) is as in Lemma [5.71 

By the properties of the net J\f guaranteed by Lemma 15.61 and ( 15. 16ft 



k^JVOIexp^-lOO^fci+i)) <1. 
Therefore for all u > and z = 1, . . . , s, 



.,..., ^, 



P( sup sup |P/r7ri(x)| > C(A/^7i"||7ri(a;)|| 00 + |7r i (x)|)v / mlog ( ) 

^xeM ic{i,...,n} V m / 

|/|=m 

< exp I — 



C-y/log(em) 
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We have for any x G A/", 

1/2 



/ 1/9 

^(v^mll^Wlloo + k(x)|) < v^( {^2h+ihi{x)\\lo) + ($^Mx)| 2 

i=l ^ i=l i=l 

< v^(2 + ~) < CVloglog(3m). 
Therefore for any u\, . . . , u s > 0, 

AT s 

P( sup sup l-PjTxl > CA/loglog(3m)A/mlog ( — ) + / uA 
\ x<aN ic{i,...,n} ' V m / -f-f / 

|/|=m *— x 

s A/" 

<V]P(sup sup |Pfr7Tj(a;)| > CXv^i+ilKOzOHcx, + |7r i (x)|) v / mlog ( )+u 

*—? \xejv ic{i,...,N } \mJ 

2 = 1 



\I\=m 
S 



< y^ exp ' 



. , Cy/log{em) 



Hence it is enough to choose u s = Ct A/log log(3m) y/m \og(eN/m) and 
Ui = \Ct^J\og\og{3m)y/m\og(eN / m) for i — 1, . . . , s — 1 and to use the fact 
that k { > im 1 / 4 for % = 2, . . . , s. □ 

5.3 Conclusion of the proof of Theorem 15.11 

Proof. First notice that it is sufficient to consider the case n < N. Indeed, if 
n > N we may find independent isotropic n-dimensional log-concave random 
vectors Xi, . . . ,X n such that X t = P^,,^Xi for 1 < i < n. Let A be the 
n x n matrix with rows Xi , . . . , X n and 

A Km := sup{|P/(v4)*x| : I c {1, . . . ,n}, \I\ = m, x e U k }. 

Then obviously Ak, m > A^^ m and this allows us to immediately deduce the 
case N < n from the case N = n. 

If \fk log(en/k) + y/mlog(eN/m) > k' log(en/k') we may apply results of 
[5]. Recall that T = A*. Let s > yk\og{en/k) + y/m\og(eN/m). Applying 
"in particular" part of Theorem 3.13 of [5] and Paouris' Theorem (inequality 
(13. 2p together with the union bound) to the columns of m x n matrix PjT 
and adjusting corresponding constants, we obtain that 

P( sup |P 7 rx| > Cs) < exp(-2s) 
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for any I C {1, . . . , N} with |/| = m (cf. Theorem 3.6 of [5J). Therefore 
F(A km > Cs) <VP( sup \PiTx\ >Cs) < I ) exp(-2s). 

\I\=m k V 7 



By the definition of k' we get 

f N 



< exp (mlog(eiV/m)) < exp [k' 'log(en//c')). 



jn 

hence for s as above 

P(A fe , m > Cs) < exp (k'\og(en/k')) exp(-2s) < exp(-s) 

and Theorem 15.11 follows in this case. 

Finally assume that n < N and that vk\og(en/k) + y/m\og(eN/m) < 
k'\og(en/k'). For simplicity put a^ = \/k\og(en/k), b m = ^/m\og(eN/m), 
d m = A/loglog(3m). If k < k' then Theorem 15.11 follows by Proposition 15.81 
applied with t = t(l + ak/(d m a m )). If k > k' then we apply Proposition 15.81 
(with the same t ) and Propositions 15.21 with t\ = t{b m d m + a k )/(a k + b m ) 
to obtain Theorem 15.11 (note that C , / lo T, \og(eN/m) > \ogN > logn, so 

the factor n in the probability in Propositions 15.21 can be eliminated). □ 

6 The Restricted Isometry Property 

Fix integers n and N > 1 and let A be an n x iV matrix. Consider the 
problem of reconstructing any vector x G M^ with short support (sparse 
vectors) from the data Ax e M. n , with a fast algorithm. 

Compressive Sensing provides a way of reconstructing the original signal 
x from its compression Ax with n <^C N by the so-called ^-minimization 
method (see [151 HI 113]). 

Let 

5 m = 5 m (A)= sup ||Ar| 2 -E|Ac| 2 | 

be the Restricted Isometry Constant (RIC) of order m, introduced in [12]. 
Its important feature is that if 62m is appropriately small then every m-sparse 
vector x can be reconstructed from its compression Ax by the ^-minimization 
method. The goal is to check this property for certain models of matrices. 
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The articles [U [21 El El E] considered random matrices with independent 
columns, and investigated the RIP for various models of matrices, includ- 
ing the log-concave Ensemble build with independent isotropic log-concave 
columns. In this setting, the quantity A n ^ m played a central role. 

In this section we consider n x N random matrices A with independent 
rows (Xi). For T C M. N the quantity A k (T) has been defined in (11.81) and 
Ak, m = A k {U m ) was estimated in the previous section. 

We start with a general Lemma 16.11 which will be used to show that 
after a suitable discretization, one can reduce a concentration inequality to a 
deviation inequality; in particular, checking the RIP is reduced to estimating 
A}- >m . It is a slight strengthening of Lemma [1.31 from the introduction. 

Lemma 6.1. Let X\, . . . , X n be independent isotropic random vectors in R . 
LetT C S^ -1 be a finite set. LetO < 9 < 1 and B > 1. Then with probability 
at least 1 — \T\ exp (—38 2 n/8B 2 ) one has 



sup 

y£T 



1 - 

-X)(K^.y>l 3 - E l(^.y>l I 

i=\ 

1 / H 

<6 + - U fc (T) 2 + supEV|(X 4 ,|/)| 2 l 



{\(Xi,y)\>B} 

<9 + -(A k (T) 2 + EA k (Tf), 

n v ' 

•where k < n is the largest integer satisfying k < {A k {T) / B) 2 . 
Remark. Note that k in Lemma [6. II is a random variable. 

To prove Lemma IBTTl we need Bernstein's inequality (see e.g., Lemma 2.2.9 
in [23]). 

Proposition 6.2. Let Z^ be independent centered random variables such that 
\Zi\ < a for all 1 < i < n. Then for all t > one has 

F(ly Zi >r)< exp (- , f n / ~] , 

Uff ) ~ V 2(a 2 + ar/3))' 



4=1 



where 



a 



a 2 = - y^V&r( Z { 
n *—* 
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Proof of Lemma \6.1\ For y G T let 



S(y) 



l -J2{\(x*,y)\ 2 -n(Xuv)\ 2 ) 

and observe that 

i 1 n 

s (y) ^ \-J2((\( x ^y)\ AB ) 2 - E (\( x -y)\ AB ) 2 ) 

8=1 

1 Tl 

1=1 

1 n 



i=l 



We denote the three summands by Si(y), S2 (y), £3 (y), respectively, and we 
estimate each of them separately. 

Estimate for S\(y): We will use Bernstein's inequality (Proposition 16. 2(1 . 
Given yeT let Z-(y) = (\(Xi,y}\ A B) 2 -E(\(X h y}\ A B) 2 Jor i < n. Then 
\Zi{y)\ < -B 2 , so a = B 2 . By isotropicity of X for every i < n one has 

Var(^(y)) < E(|(X J)2/ )| AB) 4 <E (\(X t ,y)\ 2 B 2 ) = B 2 , 



which implies a < B . By Proposition I6.2[ 



W\^Y,HV)>9\ <exp(- 



6 2 n 



2(B 2 + B 2 6/3) 



< exp 



W 2 n 
llB 2 



Then, by the union bound, 



w(supS l (y)>e] =P(supi Y,Zi{y)>o\ < |T| exp f- 

Estimates for 5*2 (y) and S^(y): For every y ET consider 

E B {y) = {i<n: \(X h y)\>B}, 

and let 

k' = sup\E B (y)\. 



36 2 n 
llB 2 
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Then, by the definition of Ay(T), 



B 2 k' = B 2 swp\E B (y)\<svip V \{X h y)\ 2 < A 2 k ,(T). 



This yields 



v < Al{T) 



B 2 ' 

and therefore k' < k, where k < n is the biggest integer satisfying k < 
(A k (T)/B) 2 . 

Using the definition of A^(T) again we observe 

1 n 1 

sup5 2 (y) < - supV|(Xj,2/)| 2 l {Kx . )3/) [>_B } = - sup V \(X h y)\ 2 

y^ T n y &T tt n y &T i^{y) 

< - supsn P ^|(X^)| 2 <i^(T). 
Similarly, 

sup 53(3/) < - supE^KX^y)! 2 ^^,,),^} < - EA 2 (T). 
2/eT ™ yeT ^ n 

Combining estimates for S\(y), 62(2/), £3(2/) we obtain the desired result. □ 

By an approximation argument Lemma 16.11 has the following immediate 
consequence (cf., [7j). 

Corollary 6.3. Let < 9 < 1 and 5 > 1. Lei n, N be positive integers and 
A be an nx N matrix, whose rows are independent isotropic random vectors 
Xi, for i < n. Assume that m < N satisfies 

, lleN 39 2 n 

mlog < — — -. 

m 16B 2 

Then with probability at least 

( 30V 

1 — exp 



16B 2 



37 



one has 



A 



5 m I — f= I = SUP 

.V n J v&ir, 



^E(K^y>l a -E|<^y>l s 

8=1 



2 
n 



<2e + -[Al m +snpEj2\(Xi,y}\ 2 l 



{\(Xi,y)\>B} 



<26 + -(Al m + EAl m ) 



n 



where k < n is the largest integer satisfying k < (Ak, m /B) 2 . 



Remarks. 1. Note that as in Lemma [6. 11 k in Corollary 16. 31 is a random 
variable. 

2. In all our applications we would like to have A\ m and EA\ m of order On. 
To obtain this, we choose the parameter B appropriately. 

3. Note that A^ )Tn is increasing in k, therefore we immediately have that if 
m < N satisfies 

, lleJV 36 2 n , ^ .„ 

m g ~frn~ ~ 16B*~ n ' m ~ 

then with probability at least 

W 2 n 



1 — exp 



one has 



VoB 2 
5 m ( A ]< 60 . 



P « m > 0n) 



(6.1) 



Proof of Corollary ] 6. 3[ Let TV be a 1/5-net in U m of cardinality (^)ll m < 

(lleN/m) m (we can construct TV in such a way that for every y G U m there 

exists z y E Af with such that ^/|^| G U m and |y — z y | < 1/5). By the 

assumption on m, 

, lleiV 3fl 2 n 
m log < 



;;/ 



1QB 2 



and thus 



' ' exp ' 'Jb 2 ' !> 



3# 2 n 
165 2 
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Using this and an obvious fact that A k (J\f) < A k {U m ) for all k, we get by 
Lemma 16.11 that 



sup 

zSJV 



n 

-]T(|(X^>| 2 -E|(X^>p 

n < * 



n 

i=\ 



< e +^ ( A lm + ^Km) 



with probability larger than or equal to 1 — exp ( — H^pr ) ■ 

The proof is now finished by an approximation argument. Note that there 
exists a self-adjoint operator S acting on the Euclidean space ~R N such that 

1 - 

-J2(\(X l7 z}\ 2 -E\(X t ,z}\ 2 ) = (Sz,z) 

i=\ 

for all z G M. N . Now pick w G U m such that 

\(Sw,w)\ = sup \{Sy,y)\, 
y&Jm 

and let / with \I\ = m contain the support of w. Write w = x + z where 
x G (1/5)5^ and z G Af and x and z are supported by /. Then 

\(Sw,w)\ = \(S(x + z),(x + z))\ 

< \(Sx,x)\ + \(Sx,z)\ + \(Sz,x)\ + \(Sz,z)\ 

< (1/25) sup \(Sx, x)\ + (2/5) sup \(Sx, x)\ sup \z\ + sup \(Sz, z)\. 

Thus 

sup \(Sy,y)\<{25/U)sup\(Sz,z)\. 
yeU m z£j\f 

completing the proof. □ 

The following theorem is a more general version of Theorem 11.41 stated in 
the introduction. 

Theorem 6.4. Let n, N be integers and < 9 < 1. Let A be an n x N 
matrix, whose rows are independent isotropic log-concave random vectors X i; 
i < n. There exists an absolute constant c > 0, such that if m < N satisfies 

, / 3max{iV, n}\ c 9 2 n 

m log log 6m log < 



m J log(3/0) 
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then 

6 m (A/Vn) < e 

with overwhelming probability. 

Remark. In fact our proof gives that there is an absolute constant c > 
such that if 

ft 3max{iV, n}\ 

b m := mloglog(3m) log < c9n (6.2) 

\ m J 

and 

3N 2 n 2 

mlog log - — < c9 n (6-3) 

m b m 

then 8 m {A/y/n) < 9 with probability at least 

/ 9 2 n \ ( \/log log(3m) Jm 3 maxjA^, n} 

1— exp — c — 7T, — ; — r — 2exp — c — , log 

F V log 2 (n/6 m )/ \ y/hg(3m) rn 

In particular, denoting a n = nj log log(3n) and Cq = [9 j \og(3/9)) 2 one can 

take 

Oon C e n \ 

log 2 (max{iV,n}/(^ n ))' log(3JV/(C fl n)) J 

if N > C e n and 

9a n 

log 2 (log \og(3n)/9) 

if N < C e n. 

Proof. Clearly it is enough to prove the estimate from the remark. So set 
b m as in (16. 2p and assume that b m < c\9n for small enough c\ > 0. Choose 
B = C\ log f-, where C\ is a sufficiently large absolute constant. 

Let k be as in Corollary I6.3[ i.e. k < n is the biggest integer satisfying 
k < (Ak t m/B) 2 . As in Theorem 15.11 denote 



m rj mm 



y/loglog{3m)y/m 

\ m = - log(emax{iV,n}/m) 

A/log(3m) 

and 

Afc im = A/k>g log (3m) \fm log(e max{ iV, n}/m) + yk\og(3n/k). 
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Applying (J5.5P we obtain that there are absolute constants C > and c > 
such that 

Ak,m < CoAfc.m, (6.4) 

with probability at least 1 — exp (— c A m ). By Holder's inequality and the log- 
concavity assumption we also obtain that there exists an absolute constant 
C 2 > such that for every y G U m one has 



Ej2\(X i ,y}\ 2 l {l{ x l ,y)\>B } <J2 SU P \\(X t ,x)\\l¥(\(X u x}\>B 



,V2 



i=l i=l ^ Sn 



< nC 2 exp(-B/C 2 ) < nC 2 (b m /n) Cl/C2 < Cl 6n 

for large enough C\. 

Below we show that for our choice of B, (16.41) implies 

vk\og(3n/k) < ^/log log(3m) \fm log(3 max{ N, n}/m) = yb mi (6.5) 



which means Ak t m < 2Coyb m . 

Note that if m satisfies (16. 3p then we can apply Corollary 16.31 with our 
choice of B. It gives that there exists a positive constant C such that 



M^ 1 <CH 



with probability at least 

( 30 2 n\ . x . 

1 - exp I ~j^ J - 2 exp (-c A m ), 

which proves the desired result. 

Now we prove that (16.41) implies (16. 5ft . Assume it does not hold, i.e. 

assume that k log 2 ^ > b m . Then, by the definition of k and (16 .4p we observe 

that 

A 2 n 2 h In 

This implies that B < 2Co\og^-, which yields 

3n 
k < 



ex P (B/(2C )) 
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Thus we obtain 



, , 2 3n 3n B 

o m < fc log -r- < 



ft ^ exp(5/(2C )) 4C 2 

3n C?log 2 (n/6 r . 



2 



exp(C 1 log(n/6 m )/(2C )) 4C 2 

which is impossible for large enough C\. This proves (16. 5p and hence com- 
pletes the proof. □ 



7 Proofs of results from Section [3 
7.1 Proof of Theorem I3T21 

Theorem 13 .21 is a strengthening of the first technical result in [18J. The proof 
given here is a modification of the argument from [18] and we include the 
details for the sake of completeness. 

First we show the following proposition (an analogue of Proposition 10 
from [18J). 

Proposition 7.1. There exist an absolute positive constant Co such that the 
following holds. Let X be an isotropic log-concave N -dimensional random 
vector, A = {X e K}, where K is a convex set in M. N satisfying < ¥(A) < 
1/e. Then for every t > Cq 

N 

J>(An{X(*) >£}) <C P(A)(r 2 4(-log(P(A))) + iVe- t/C70 ) (7.1) 



and for every 1 < u < 4r 



c 



\{i < N: F(A R {X(t) > t}) > e- u F(A)}\ < -^ (T |(-l g(P(A))). (7.2) 



Cou 2 

t 2 



Proof. Let Y be a random vector defined by 

¥(An{x eB}) F(XeBnK) 



¥(Y e B) 



F(A) F(X E K) 



i.e. Y is distributed as X conditioned on A. Clearly, for every measurable 
set B one has P(X G B) > F(A)F(Y G B). 
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It is easy to see that Y is log-concave, but not necessarily isotropic. With- 
out loss of generality we assume that EF(1) 2 > EF(2) 2 > . . . > EY(N) 2 
(otherwise we remunerate coordinates). 

Given a > denote 

m = m(pc) = \{i: EY(i) 2 > a}\ . 

Then EF(1) 2 > . . . > EY(m) 2 > a. Using the Paley-Zygmund inequality 
and log-concavity of Y, we get 

p(X>« 2 ^ 2 am ) - p (X y(i)2 ^ 2 E 5> W 

i gE£ing!)! ' j 

-4E(Er=i^W 2 ) 2 -Ci' 

Therefore 



p(^X(i) 2 > -am) >P(A)p(^y(i) 2 > -am) > — F(A). 



»=1 i=l 



Applying Theorem 13.11 (and Chebyshev's inequality, cf. f !3.2p ) to the Tri- 
dimensional vector X = (X 1; . . . , X m ) we observe 

p(^X(f) 2 ^ o am ) < ex P ( - ^(ttV™)) for a > C 3 . 

Thus exp(-ff x 1 (^-i/ma)) > P(A)/Ci for a > C3, so, using the fact that 
&x{tp) < 2£<Tx(p) for £ > 1, we obtain that 

m(a) = \{i: EY(if > a}\ < — al(- log(P(A))) for a > C 3 . (7.3) 

a 

Note that for every i the random variable Y(i) is log-concave, hence 
F(An{X(i)>t}) _ / t x 

p(A) ~ n w - j - exp v c 5 (EY(z) 2 )V2j- 

Thus, if P(Y(i) > t) > e- u then (EF(i) 2 ) 1 / 2 > t/(C 5 (u + 1)). Applying 
fT7T3|) with a = t 2 /(C 5 (u + l)) 2 we obtain that (T7T2]) holds with constant C 6 
provided that 1 < u < tjC-j. 
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Now assume that t > \/Cl and define a nonnegative integer fc by 2 k °t > 
^/Cl > 2- k °-H. Let 

I = {i: EF(z) 2 > t 2 }, I ko+1 = {i: EY(t) 2 < A- k H 2 } 

and 

Ij = {% : A~H 2 < EY(i) 2 < A l -H 2 } j = 1, 2, ... , fc . 

Clearly |4 0+ i| < iV and, by (Q , 

|i"il < C 4 4 j r 2 4(- logP(A)) for j = 0, 1, ... , fc„- 
Observe also that for j > and i G Ij one has 

^W > ') < F( B ^| W j > 2-') < exp (l - ^ 



Therefore 

N fc + l ^0 + 1 r,j 

J2 V(Y(i) >t) = J2J2 P ( F « ^ *) < \h\ + e ^ |/i| exp ( - -) 
j=i i=o ie/, 3=1 8 

<C , 4 (Vv|(-logP(A))fl + e|S J exp(-|^ + eN e - t/{cVU ^ 

< d(r 2 4(-logP(A)) + iVe- t/Cl ). 

By the definition of y, this proves (j7.ip with constant C*i for £ > v^j- 
Taking C = max{Ci, a/C^, C 6 , C 7 } completes the proof. □ 

We will use the following simple combinatorial lemma (Lemma 11 in [T8]). 

Lemma 7.2. Let £q > t\ > . . . > £ s be a fixed sequence of positive integers 
and 

^={/:{l,2,...,4}->{0,l,2,..., S }: Vi<i< a \{r : f(r) > i}\ < £,}. 
Then 

i=l 
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Proof of Theorem \3.S[ Since N x < N, the statement is trivial if tyN < 
Ca x (p). Without loss of generality we assume that ty/N > Ca x (p) for large 
enough absolute constant C > 0. 

Let Cq be the constant from Proposition 17. II Since X is isotropic and log- 
concave we may assume that F(X(j) > t) < e~ l l Co for t > Cq and 1 < j < N 
(we increase the actual value of C if needed) . Fix p > 1 and 

Then, for large enough C, t > 4C and t 2 Ne~ t/Co < a x (p). 
Define a positive integer £ by 

p < £ < 2p and £ = 2 for some integer fc. 

Then cr x (p) < a x {£) < a x (2p) < 4a x (p). Since (E(iV x (*) ) p ) 1/p < {E(N x {t)) e y", 
it is enough to show that 

Ht 2 N x (t)Y < (C l( r x (£)) 2i . 

Define sets 

B ll _ is = {X(i l )>t,...,X(i s )>t} and B % = fi 

and denote 



N „ N 

" '- \ ^ 

=1 ii,...,i/=l 



It is enough to prove 



We divide the sum in m(£) into several parts. Let j\ > 2 be an integer 
satisfying 

Define sets 

Jo = {(ii, ...,ie)e{l,...,Ny: F(B iu ... tit ) > e~ e }, 
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I, = {(h,...,i e ) E {l,...,N} e : nB tl _ le ) G (e- 2 ^, e" 2J ^]}, < j < j lt 

and 

I n = {(i!,...,^) G {l,...,iV} £ : P^,...,^) < e- 2h ~ H }. 

Note {1, . . . , iV}^ = UJLo J i> hence m W = £?=o m i W> where 



m j 



{£):= Yl ^ B h,.,h) forO<j<ji. 

(*l,...,v)6Jj 



First we estimate mj x {£) and mo(l). Since j/jj < iV £ 

(h,...,i i )eij l 
To estimate m (£), given J C {1, . . . , N} e and 1 < s < £, define 
P 8 I = {{h, ■ ■ ■ , is) ■ (k, ■ ■ ■ , k) £ I for some z s+1 , . . . , ^}. 
By Proposition 17.11 for s = 1, ...,£— 1 one has 

E p(^u,..., s+1 ) < E E p ( B «i.....«. n Ww) ^ 0) 

(ii,...,i s +i)GP a +i-fo (ii,...,j a )eP s /o »«+i=i 

< Co E P(^i,~,i.)(*" a <4(-logP(B fll „. i O) H-iVe-^). 

(Jl,...,« s )6P s / ( ) 

Note that for (ii,...,z«) € P s / one has P( J B ili ... iis ) > e" £ and, by ( FT4|) . 
t 2 Ne -t/c < p.2.^ < ^(^ Therefore 

E F (^,..,w) < c 4 i- 2 4(£) ^ p(5 ? ,,..,j- 

(ii,...,i s+ i)eP s+ ii"o (ii,...,i s )eP s Jo 

By induction and since ¥(X(j) > t) < e^ t ^ Co we obtain 

m (£) = J2 p ( 5 n,..,J < (c.r^MY- 1 J2 p ( 5 n) 
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Now we estimate rrij(£) for < j < j\. The upper bound is based on 
suitable estimates for \Ij\. Fix < j < j% and define a positive integer r% by 

2 ri < — < 2 ri+1 . 
Co 

For all («i, . . . ,ie) G Ij define a function f il; ... iit : {1, . . . ,£} ->■ {j, j + 1, . . . , rj 

by 

f j if P^,...,*.) > exp(-2^ 1 )P( J B Jl ,..., i _ 1 ), 
/n,..,^) = { r if exp(-2- +1 ) < P(B ili ..., < .)/P(B il ,.„ >i ,_ 1 ) < exp(-2 r ), j < r < n, 
[ n if P^,...^) < exp(-2^)P(S il ,„. ii ._ 1 ). 

Note that for every (zi, . . . , Z|) G /,,■ one has 

1 = P(S ) > P(^) > P(S <1)4a ) > . . . > ¥(B iu ... A ) > exp(-2^) 

and f iu ... M {l) = n, because P(X(ii) > t) < exp (-t/C ) < exp(-2 f ' 1 )P( J B ). 
Denote 

■Fj := {fi u ...,n : (*i, •••,*/) e /j}. 
Then for / = fi lt ...,i e G J-j- and every r > j one has 



«p(-2>/) < P(5 n ,...,0 = ]J J R n '-'"\ < exp(-2' \{s: f(s) > r}\). 

s =l V^lv.is-lJ 

Hence for every r > j (the case r = j is trivial) one has 

\{s;f{s)>r}\<y- r e=:£ r . (7.6) 

Clearly, JT=i + i ^ r < ^ an d ^r-i/4- = 2, so by Lemma I7T21 



itt i ^ rr f e ^--i\^ ^ 2 



+1 y— ) - 2 ' 

r=j+l 

Now for every / G J-j we estimate the cardinality of the set 

W) ■= {(h,---,ii) elj'. fh,...,i e =/}■ 
Fix / and for r = j, j + 1, . . . , r\ set 

v4 r := {s G {1, ...,£}: f(s) = r} and n r := \A r \ 
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Then 1 G A ri and 

rij + n j+1 + . . . + n n = L 

Fixing r < n, n, . . . ,i,_i, s6i r (then s > 2 and P(Si 1 ,...,i._ 1 ) < P(-B 4 J < 
exp(— t/C ) < 1/e), applying (j7.2p with u = 2 r+1 < t/C , and using the 
definition of Ij, we observe that i s may take at most 

^(-icgpw „.,)) < ^<*o < 16C ° 22I ;; % - (Q 

^ — -^ Ll ex p( 2 ( r + ■?)) =: m - 

values in order to satisfy fi u ...,i t = f '■ Thus 

IW)I < jv* n»f = JV- (I^IM)'-' exp g 2(r + 3) , 

r=j r=j 

Note that (17. 6p implies that n r < £ r = 2 J_r £, so 
n— 1 oo 

J] 2(r + j> r < 2 J+2 £ J2 r2 ~ r = 8 C? + ^ ^ ( 50 + 2J " 2 ) £ - 

r=j r=j 

By the definition of r\ we also have 

ri " ~ t 2 "-log(iVtV(4a|(£)))' 

where in the last inequality we used ( I7.4p with large enough C Thus we 
obtain that for every / G Tj 

This implies that 



'^M^MH^m^K* 



™;W = X) P(i?n,..,J < 141 exp(-2^£) < (^f^j exp (-2* 
(n,...,^)eij 
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Combining estimates for mj(^)'s we obtain 

ii-i 



(£) = m (£) + m h {t) + ^ mj (t) 

3=1 

< (f^)"^ + 1+ J C «exp(-2^)) < y—^j 



which proves ( 17.5!) . D 



7.2 Proof of Theorem 1X41 

Fix t > 1 and let mo = mo(X, £). 

Since crpjx < 0"x for every J C {1, . . . , iV}, Theorem 13.11 gives for any 
J C {1, . . . , N} of cardinality m , 

(ElPjXH 1 ^ < dCVm^ + ^xCp)) < CxCV^+oxCp)). 

Using the Chebyshev inequality and a x {up) < 2uax(p) we observe for such 
J, 



Pfl^Pj^l > SGCitv^fog (— )) < ex P ( - <? x x (m\/m\og (— ' 

< exp ( - 3<7^ (tv^fog (^f))) • 
Thus, using the definition of mo and that <r^ 1 (l) = 2, we obtain 

P( sup \PjX\>36Cit^hg(—]\ 

\\J\=m \mJJ 

^5 <K p(-"x(*v'Slog(^)))- (7.7) 



Now notice that 




















sup |PfX| 
|/|=m 


m 

= (!>' 


\ I/ 2 


< 


sup 

\J\=m 


\PjX\ 


8-X 

+ (5> 

j=0 


'm 


|X : 


K (2* 


\ I/ 2 

™o)| 2 ) 
(7.8) 
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with s = |~log 2 (m/m )] < 21og(em/m ). By Theorem 13.31 we get for u > 0, 

^) + ^)<exp(-^(i- 



p(|AT*(2'm„)| 2 > C 2 log 2 (^-) + « 2 ) < exp ( - aj 1 (i-tfl" 2 ^ 



We have 

C 2 X>m log 2 (£-) < C 4 mlog 2 (^). 
^^ \2 l mn/ \ m / 

«=o u 

Therefore for any w , . . . , «,,_! > 0, 

S-l , T S-l 



«? 



p(^2 4 m |X*(2 4 m )| 2 > C 4 mlog 2 (— ) + J] 

j=0 

s-l 

<X^ exp (~ cT ^ 1 (^ u 



j=0 i=0 

s-l 



i=0 ~ 3 



,2 _ 2Cf ,o, ^2/eA^ 



Take u~ = — -i 2 mlog (— ). Since s < 21og(em/mo), we obtain 

s-l 

9 i m.JX*(9 i m. n )\ 2 > (C, + 5>rL 2 V; 2 WW 2 



P(^2 4 m |X*(2 i m )| 2 > (C 4 + 2C|t 2 )mlog 2 (— "i 



< - exp ( — a x x [ ty/mlog ( ) 

V \*/]oe(am,/m,n) \ m J 



4=0 

< sexp 

2 l v V y/log(em/m ) 

This together with ( 17.7ft and ( 17.8P completes the proof. □ 
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